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1. Introduction 



In the author proved that in characteristic the jacobian J{C) — J{Cf ) of 
a hypereUiptic curve 

C^Cf:y^ = fix) 

has only trivial endomorphisms over an algebraic closure Ka of the ground field K 
if the Galois group Gal(/) of the irreducible polynomial / G K[x] is "very big". 
Namely, if 71 = deg(/) > 5 and Gal(/) is cither the symmetric group S„ or the 
alternating group A„ then the ring End(J(C/)) of Xa-endomorphisms of J{Cf) 
coincides with Z. Later the author proved that End( J(C/)) = Z for an infinite 
series of Gal(/) = PSL2(F20 and n = 2'' + 1 (with dim(J(C/)) = 2'-i) or when 
Gal(/) is the Suzuki group Sz(22'-+i) and n = 22(2'+i) + 1 (with dim(J(C/)) = 
24''+!). We refer the reader to §, §], §, §, |l| for a discussion 

of known results about, and examples of, hypereUiptic jacobians without complex 
multiplication. 

We write [H = [H/ for the set of roots of / and consider Gal(/) as the correspond- 
ing permutation group of $H. Suppose q = 2'" > 2 is an integral power of 2 and 
Fg2 is a finite field consisting of elements. Let us consider a non-degenerate Her- 
mitian (wrt x i—> x'^) sesquilinear form on F^2- In the present paper we prove that 
End(J(C/)) — Z when d\f can be identified with the corresponding "Hermitian 
curve" of isotropic lines in the projective plane P^(Fq2) in such a way that Gal(/), 
becomes either the projective unitary group PGU3(Fq) or the projective special 
unitary group U3(g) := PSU3(Fg). In this case n = deg(/) ^ + 1 = 2^'" + 1 and 
dim( J(C/)) = q^/2 = 2^"'-\ 

Our proof is based on an observation that the Steinberg representation is the 
only absolutely irreducible nontrivial representation (up to an isomorphism) over 
F2 of 113(2™), whose dimension is a power of 2. 

2. Main results 

Throughout this paper we assume that X is a field with char(iir) ^ 2. We fix its 
algebraic closure Ka and write Gal(if) for the absolute Galois group Ant{Ka/ K). 
If X is an abelian variety defined over K then we write End(X) for the ring of 
i^a-endomorphisms of X . 

Suppose f{x) G K[x] is a separable polynomial of degree n> 5. Let 9^ = 9^/ C 
Ka be the set of roots of /, let K{Dif) — K{Dl) be the splitting field of / and 
Gal(/) := Ga,l{K{yVj/K) the Galois group of /, viewed as a subgroup of Perm($H). 
Let Cf be the hypereUiptic curve = f{x). Let J{Cf ) be its jacobian, End(J(C/)) 
the ring of i^a-endomorphisms of J(Cf). 
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Theorem 2.1. Assume that there exist a positive integer m > 1 such that n — 
23m+i ^ ^ Gal(/) contains a subgroup isomorphic to U3(2™). Then either 
End( J(C/)) = Z or char(X) > and J{Cf) is a supersingular abelian variety. 



We will prove Theorems 2.1 in §pl 



3. Permutation groups, permutation modules and very simplicity 

Let B he a, finite set consisting of n > 5 elements. We write Perm(i?) for the 
group of permutations of _B. A choice of ordering on B gives rise to an isomorphism 

Perm(B) ^ S„. 

Let G be a subgroup of Perm(i3). For each 6 G -B we write Gb for the stabilizer of 
b in G; it is a subgroup of G. Further we always assume that n is odd. 

Remark 3.1. Assume that the action of G on B is transitive. It is well-known 
that each Gb is of index n in G and all the G^'s are conjugate in G. Each conjugate 
of Gb in G is the stabilizer of a point of i?. In addition, one may identify the G-set 
B with the set of cosets G/Gb with the standard action by G. 

We write for the n-dimensional F-vector space of maps h : B ^ F2. The 
space F^ is provided with a natural action of Perm(i3) defined as follows. Each 
s e Perm(i3) sends a map h : B ^ F2 into sh : b ^ h{s~^{b)). The permutation 
module Ff contains the Perm(_B)-stable hyperplane 

Qb :={/i:B^F2 |^/i(6)=0} 

b£B 

and the Perm(B)-invariant line F ■ 1^ where Is is the constant function 1. Since 
n is odd, there is a Perm(i?)-invariant splitting 

Ff =Qb®F2-1s. 

Clearly, 

dimF2((9B) = n - 1 

and F2 and Qb carry natural structures of G-modules. Clearly, Qb is a faithful 
G-module. It is also clear that the G-module Qb can be viewed as the reduction 
modulo 2 of the Q[G]-module 

(Q^)0 ■.= {h:B^Q\Y,m = 0}- 

beB 

It is well-known that the Q[G] -module (0^)'~' is absolutely simple if and only if the 
action of G on i? is doubly transitive Sect. 2.3, Ex. 2). 

Remark 3.2. Assume that G acts on B doubly transitively and #(-B) — 1 = 
dimQ((QB)") coincides with the largest power of 2 dividing #(G). Then it fol- 
lows from a theorem of Brauer-Nesbitt Sect. 16.4, pp. 136-137 ; [§, p. 249) 
that is an absolutely simple F2[G]-module. In particular, is (the reduction 
of) the Steinberg representation [gj. 

We refer to ||l^ for a discussion of the following definition. 
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Definition 3.3. Let be a vector space over a field F, let G be a group and 
p : G ^ AutF(l^) a linear representation of G in V. We say that the G-module V 
is very simple if it enjoys the following property: 

If i? C EndF(V') is an F-subalgebra containing the identity operator Id such that 

p{a)Rp{a)-^ CR Vcr e G 
then either i? = F • Id or i? = EndpCV"). 

Remarks 3.4. (i) If G' is a subgroup of G and the G'-module V is very simple 
then obviously the G-module V is also very simple. 



(ii) A very simple module is absolutely simple (see |13 , Remark 2.2(ii)). 

(iii) If dimp (V) — 1 then obviously the G-module V is very simple. 

(iv) Assume that the G-module V is very simple and dimF(F) > 1. Then V is 
not induced from a subgroup G (except G itself) and is not isomorphic to 
a tensor product of two G-modules, whose F-dimension is strictly less than 
dimF(y) (see ]l3|, Examples 7.1). 

(v) If F = F2 and G is perfect then properties (ii)-(iv) characterize the very 
simple G-modules (see |l|], Th. 7.7). 

The following statement provides a criterion of very simplicity over F2. 

Theorem 3.5. Suppose a positive integer N > 1 and a group H enjoy the following 
properties: 

• H does not contain a subgroup of index dividing N except H itself. 

• Let N = ab be a factorization of N into a product of two positive integers 
a > I and b > I. Then either there does not exist an absolutely simple 
F2[H]-module of F 2 -dimension a or there does not exist an absolutely simple 
F2[H]-module of F 2- dimension b. 

Then each absolutely simple F2[H]-module of F 2- dimension N is very simple. 
Proof This is Corollary 4.12 of ||l3|. □ 

4. Steinberg representation 

We refer to Q and j^] for a definition and basic properties of Steinberg repre- 
sentations. 

Let us fix an algebraic closure of F2 and denote it by !F. We write 4> : T ^ J- 
for the Frobenius automorphism x i—> x'^. Let q — 2™ be a positive integral power 
of two. Then the subfield of invariants of (j)"^ : — > is a finite field Fq consisting 
of q elements. Let q' be an integral positive power of q. If d is a positive integer 
and i is a non-negative integer then for each matrix u G GLdi^) we write u^'^ for 
the matrix obtained by raising each entry of u to the 2Hh power. 

Remark 4.1. Recall that an element a £ Fg is called primitive if a 7^ and has 
multiplicative order g — 1 in the cyclic multiplicative group F* . 
Let M < g — 1 be a positive integer. Clearly, the set 

Mm(F,) = {a e F, I a*^ = 1} 

is a cyclic multiplicative subgroup of F* and its order M' divides both M and q—1. 
Since M < q — 1 and g — 1 is odd, the ratio {q — 1)/M' is an odd integer > 1. This 
implies that 3 < (g — 1)/A/' and therefore 

M' = #(/iM(F,)) < (g-l)/3. 
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Lemma 4.2. Let q > 2, let d be a positive integer and let G be a subgroup of 
GLd(Fg/). Assume that one of the following two conditions holds: 

(i) There exists an element u E G C Gh^(Fqr), whose trace a lies in F* and has 
multiplicative order g — 1; 

(ii) There are exist a positive integer r > distinct ai, - ■ ■ ,ar & F* and 
elements 

Ml, • • • ,Ur e G C GLd(F,0 

such that the trace of Ui is a; for all i — 1, ■ ■ ■ , r. 

Let Vo = T'^ and pq : G C GLrf(F,0 C GL<j(J^) = Autjr(Vo) be the natural d- 
dimensional representation of G over T . For each positive integer i < m we define 
a d-dimensional J- -representation 

p,:G^ Aut{Vi) 

as the composition of 

G-^GLrf(F,0, 

and the inclusion map 

GhdiFg,) c GLrf(^) - AuV(l^,)- 

Let S be a subset of {0, 1, . . . to— 1}. Let us define a d'^^^^ -dimensional J- -representation 
ps of G as the tensor product of representations pi for all i €z S . If S is a proper 
subset of {0, 1, ... TO — 1} then there exists an element u G G such that the trace of 
Psiu) does not belong to F2. In particular, pg could not be obtained by extension 
of scalars to T from a representation of G over F2. 



Proof. Clearly, 



tr(p,(u)) = {ti{poiu)f Vu e G. 



This implies easily that 

tiipsiu)) = lltr{p,{u)) ^ (tiipoiu))'' 
ies 

where AI = J2ies Since S' is a proper subset of {0, 1, ... to — 1}, we have 

m — 1 

< Af < ^ 2' = 2" - 1 = #(f;). 

2 = 

Assume that the condition (i) holds. Then there exists u € G such that a — 
tr(po(u)) lies in F* and the exact multiplicative order of a is g — 1 = 2™ — 1. 

This implies that =^ a'^ ^ 1. Since F2 ^ {0, 1}, we conclude that a*^ ^ F2. 
Therefore 

tripsin)) ^ {tr{po{u)f' ^ a'WF2. 



Now assume that the condition (ii) holds. It follows from Remark 4.1 that there 
exists a = a; ^ such that a^'^ 7^ 1 for some i with 1 < i < r. This implies that if 
we put u = Ui then 

tr(p5(«)) = (tr(poM)''=a^'^F2. 

□ 
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Now, let US put q' — — p^'". We write x ^ x for the involution a a'' of 
Fg. Let us consider the special unitary group SU3(Fg) consisting of all matrices 
A e SL3 (Fq2 ) which preserve a nondegenerate Hermitian sesquilinear form on F^2 
say, 

x,y^ xiVs + X2y2 + xsyi Vx = (xi, X2, xa), y = {yi,y2,v?.)- 
It is well-known that the conjugacy class of the special unitary group in GL3(Fq2) 
does not depend on the choice of Hermitian form and #(SU3(Fg)) ~ {q^ + l)q^{q^ — 
1). Clearly, for each /3 G F* the group SU3(Fg) contains the diagonal matrix 
u — diag(/?, 1, /3^^) with eigenvalues /3, 1, (3~^] clearly, the trace of u is /3 + (3^^ + 1. 

Theorem 4.3. Suppose G = SU3(Fg). Suppose V is an absolutely simple nontriv- 
ial F2[G]-module. Assume that m > 1. //dimF2(V^) is a power of 2 then it is equal 
to q^ . In particular, V is the Steinberg representation o/SU3(Fg). 

Proof. Recall ( [||, p. 77, 2.8.10c), that the adjoint representation of G in Endp^^ (Fgs) 
splits into a direct sum of the trivial one-dimensional representation (scalars) and 
an absolutely simple Fg2 [G]-module St2 of dimension 8 (traceless operators). The 
kernel of the natural homomorphism 

G = SU3(Fg) ^ AutF^2(St2) = GL8(F,2) 

coincides with the center Z(G) which is either trivial or a cyclic group of order 3 
depending on whether (3, (7 + 1) = 1 or 3. In both cases we get an embedding 

G' := G/ZiG) = Vaiq) = PSU3(F,) c GL8(F,2). 

If m = 2 (i.e., q — 4) then G — SU3(F4) = U3(4) and one may use Brauer 
character tables js) in order to study absolutely irreducible representations of G in 
characteristic 2. Notice p. 284) that the reduction modulo 2 of the irrational 
constant b5 does not lie in F2. Using the Table on p. 70 of we conclude that 
there is only one (up to an isomorphism) absolutely irreducible representation of 
G defined over F2 and its dimension is 64 = g^. This proves the assertion of the 
theorem in the case of m = 2, g = 4. So further we assume that 

TO > 3, q^ 2" > 8. 

Clearly, for each u <E G C GL3(Fg2) with trace S G Fg2 the image u' of u in G' 
has trace (5(5 — 1 £ Fq. In particular, ii u — diag(/3, l,i3~-^) with /3 G F* then the 
trace of u' is 

tr(ii') = (! + /? + p-^){l +P + /3-I) - 1 = (/3 + 
Now let us start to vary j3 in the q — 2-element set 

f,\F2-f;\{i}. 

One may easily check that the set of all t^'s consists of elements of F*. Since 

q-2 q-l 
r := — - — > — - — . 



This implies that G' C GLg(Fg2) satisfies the conditions of Lemma 4.2 with d = 8. 
In particular, none of representations ps of G' could be realized over F2 if S is 
a proper subset of {0, 1, . . . , to — 1}. On the other hand, it is known (|^, p. 77, 
Example 2.8.10c) that each absolutely irreducible representation of G over !F either 
has dimension divisible by 3 or is isomorphic to the representation obtained from 
some Ps via G ^ G'. The rest is clear. □ 
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Theorem 4.4. Suppose m > \ is an integer and let us put q = 2™. Let B be 
a (q^ + l)-element set. Let G' be a group acting faithfully on B. Assume that 
G' contains a subgroup G isomorphic to \J^{q). Then the G' -module Qb is very 
simple. 

Proof. First, \]'i{q) is a simple non-abelian group, whose order is q'^{q^ + — 
l)/(3,g+ 1) (§, p. XVI, Table 6; [|, pp. 39-40). Second, notice that \Js.{q) C G' 
acts transitively on B. Indeed, the classification of subgroups of \3j,{q) (Q, Th. 
6.5.3 and its proof, p. 329-332) implies that each subgroup of \J7i{q) has index 

> q'^ + 1 = #(-8). This implies that \J7i{q) acts transitively on B. Third, we claim 
that this action is, in fact, doubly transitive. Indeed, the stabilizer \5^{q)i) of a 
point b B has index g'^ + 1 in U3(q). It follows easily from the same classification 
that U3(g)f, is (the image of) the stabilizer (in SU3(Fg)) of a proper subspace L 
in F^2 . If L is a plane then counting arguments imply that the restriction of the 
Hermitian form to L could not be non-degenerate and therefore \J3{q)i, coincides 
with (the image of) the stabilizer of certain isotropic line L' C L C F^a . (The line 
L' is the orthogonal complement of L.) If L is a line then counting arguments imply 
that L is isotropic. Hence we may always assume that U3(g)b is (the image of) the 
stabilizer of an isotropic line in F^2 • Taking into account that the set of isotropic 
lines in F^a has cardinality q'^ + 1 = #(i?), we conclude that B = lJ3{q)/lJ3{q)b is 
isomorphic (as U3((7)-set) to the set of isotropic lines on which XJsiq) acts doubly 
transitively and we are done. 

By Remark the double transitivity implies that the F2[U3(q)]-module is 
absolutely simple. Since SU3(Fg) ^siq) is surjective, the F2[SU3(Fg)]-module 
is also absolutely simple. Also, in order to prove that F2[U3((7)]-module Qb is 
very simple, it suffices to check that the F2[SU3(g)]-module Qb is very simple. 

Recall that dhjiF^{QB) = #(S) - 1 = q^ = 1?"^ . By Theorem |4!^, there no 
absolutely simple nontrivial F2[SU3(Fq)]-modules, whose dimension strictty divides 
23m xhis implies that is not isomorphic to a tensor product of absolutely 
simple F2[SU3(Fg)]-modules of dimension > 1. Therefore Qs is not isomorphic 
to a tensor product of absolutely simple F2[U3((7)]-modules of dimension > 1. 
Recall that all subgroups in G = U3(g) different from U3(g) itself have index 

> + 1 > = dimF2((5s). It follows from Corollary |3.5| that the G- module Qb 
is very simple. 

□ 



5. Proof of Theorems 2.1 



Recall that Gal(/) C Perm(fH). It is also known that the natural homomor- 
phism Gal(_fi') Autpa (>/(C')2) factors through the canonical surjection Gal(X) 
Q>'d!i{K(SK)l K') — Gal(/) and the Gal(/)-modules J{C)i and Qsr are isomorphic 
(see, for instance, Th. 5.1 of jl^). In particular, if the Gal(/)-module Qt^ is 
very simple then the Gal(/)-modules J{C)i is also very simple and therefore is 
absolutely simple. 

Lemma 5.1. If the Gal{f)-module Qy^ is very simple then either F,iid{ J {C f)) — Z 
or cha,T{K) > and J{Gf) is a supersingular abelian variety. 

Proof This is Corollary 5.3 of O]. □ 
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It follows from Theorem 4.4 that under the assumptions of Theorem 2.1, the 



Gal(/)-module is very simple. Applying Lemma 5.1, we conclude that either 



End( J(C/)) = Z or chaT{K) > and J{Cf) is a supersingular abelian variety. 
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